Subjectivity in Clone Judgment: Can We Ever Agree?
نویسندگان
چکیده
An objective definition of what a code clone is currently eludes the field. A small study was performed at an international workshop to elicit judgments and discussions from world experts regarding what characteristics define a code clone. Less than half of the clone candidates judged had 80% agreement amongst the judges. Judges appeared to differ primarily in their criteria for judgment rather than their interpretation of the clone candidates. In subsequent open discussion the judges provided several reasons for their judgments. The study casts additional doubt on the reliability of experimental results in the field when the full criterion for clone judgment is not spelled out.
منابع مشابه
Reconceptualising Religion : A Philosophical Critique of Religious Studies as Cultural Studies
The aim of my argument (1) is to reconceptualise what is now called religious studies as the study of institutionalised values, and the relation between values and the legitimation of power in a specific society. Though I do not talk much about power here, it is always a fundamental issue in the study of specific social groups.The first assumption which I make in this paper is that the way anal...
متن کاملMHSubLex: Using Metaheuristic Methods for Subjectivity Classification of Microblogs
In Web 2.0, people are free to share their experiences, views, and opinions. One of the problems that arises in web 2.0 is the sentiment analysis of texts produced by users in outlets such as Twitter. One of main the tasks of sentiment analysis is subjectivity classification. Our aim is to classify the subjectivity of Tweets. To this end, we create subjectivity lexicons in which the words into ...
متن کاملAdjectives as Indicators of Subjectivity in Documents
The goal of this research is to automatically predict human judgments of document qualities such as subjectivity, verbosity and depth. In this paper, we explore the behavior of adjectives as indicators of subjectivity in documents. Specifically, we test whether a subset of automatically derived subjective adjectives (Wiebe, 2000b), selected a priori, behaves differently than other adjectives. 3...
متن کاملBayesian Statistical Pragmatism. Discussion of Statistical Inference: The Big Picture by R. E. Kass
Kass describes probability theory as anchored upon physical randomization (coin flips, die rolls and the like) but being useful more generally as a mathematical model. I completely agree but would also add another anchoring point: calibration. Calibration of probability assessments is an objective, not subjective process, although some subjectivity (or scientific judgment) is necessarily involv...
متن کاملA Comparison of Service Quality in Teaching and Non-teaching Hospitals: The Gap Analysis
Introduction: Service quality is a judgment that the customer compares his/her expectations by this judgment, with the perception of the received services. The purpose of this study was to compare service quality in teaching hospitals with non-teaching hospitals in Kerman city. Methods: This cross-sectional study has been done on 166 hospitalized patients...
متن کامل